A Metropolis - type Optimization Algorithm on theIn

نویسنده

  • David Aldous
چکیده

Let S(v) be a function deened on the vertices v of the innnite binary tree. One algorithm to seek large positive values of S is the Metropolis-type Markov chain (X n) deened by P (X n+1 = wjX n = v) = 1 3 e b(S(w)?S(v)) 1 + e b(S(w)?S(v)) for each neighbor w of v, where b is a parameter (\1=temperature") which the user can choose. We introduce and motivate study of this algorithm under a probability model for the objective function S, in which S is \tree-indexed simple random walk", that is the increments (e) = S(w)?S(v) along parent-child edges e = (v; w) are independent and P (= 1) = p; P (= ?1) = 1 ? p. This algorithm has a \speed" r(p; b) = lim n n ?1 ES(X n). We study the speed via a mixture of rigorous arguments, non-rigorous arguments and Monte Carlo simulations, and compare with a deterministic greedy algorithm which permits rigorous analysis. Formalizing the non-rigorous arguments presents a challenging problem. Mathematically, the subject is in part analogous to recent work of Lyons-Pemantle-Peres (1995,1996) on the speed on random walk on Galton-Watson trees. A key feature of the model is existence of a critical point p crit below which the problem is infeasible; we study behavior of algorithms as p # p crit. Preliminary version. See homepage for updates.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Metropolis-type Annealing Algorithms for Global Optimization in IRd

We establish the convergence of a class of Metropolis-type Markov chain annealing algorithms for global optimization of a smooth function U(.) on Rd. No prior information is assumed as to what bounded region contains a global minimum. Our analysis is based on writing the Metropolis-type algorithm in the form of a recursive stochastic algorithm Xk+l = Xk ak(VU(Xk) + Jk) + bkWk, where {Wk} are in...

متن کامل

A Simulated Annealing Algorithm for the Satisfiability Problem Using Dynamic Markov Chains with Linear Regression Equilibrium

Since the appearance of Simulated Annealing algorithm it has shown to be an efficient method to solve combinatorial optimization problems such as Boolean Satisfiability problem. New algorithms based on two cycles: one external for temperatures and other internal, named Metropolis, have emerged. These algorithms usually use the sameMarkov chain length in the Metropolis cycle for each temperature...

متن کامل

Metropolis Sampling

Monte Carlo (MC) sampling methods are widely applied in Bayesian inference, system simulation and optimization problems. The Markov Chain Monte Carlo (MCMC) algorithms are a well-known class of MC methods which generate a Markov chain with the desired invariant distribution. In this document, we focus on the Metropolis-Hastings (MH) sampler, which can be considered as the atom of the MCMC techn...

متن کامل

An Optimization of System for Automatic Recognition of Ischemic Stroke Areas in Computed Tomography Images

The paper considers application of stochastic optimization to system of automatic recognition of ischemic stroke area on computed tomography (CT) images. The algorithm of recognition depends on five inputs that influence the results of automatic detection. The quality of recognition is measured by size of conjunction of ethalone image and the image calculated by the program of automatic detecti...

متن کامل

Efficient Algorithms for Inferences on Grassmann Manifolds

Linear representations and linear dimension reduction techniques are very common in signal and image processing. Many such applications reduce to solving problems of stochastic optimizations or statistical inferences on the set of all subspaces, i.e. a Grassmann manifold. Central to solving them is the computation of an “exponential” map (for constructing geodesics) and its inverse on a Grassma...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1997